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Abstract — We consider two-way interference channels (ICs) 
where forward and bacltward channels are ICs but not nec- 
essarily the same. We first consider a scenario where there are 
only two forward messages and feedback is offered through the 
backward IC for aiding forward-message transmission. For a 
linear deterministic model of this channel, we develop inner and 
outer bounds that match for a wide range of channel parameters. 
We find that the backward IC can be more efficiently used 
for feedback rather than if it were used for sending its own 

' independent backward messages. As a consequence, we show that 
feedback can provide a net increase in capacity even if feedback 
cost is taken into consideration. Moreover we extend this to a 
more general scenario with two additional independent backward 

I messages, from which we find that interaction can provide an 
arbitrarily large gain in capacity. 

Index Terms — Feedback Capacity, Interaction, Net Feedback 
Gain, Two-way Interference Channels 

I. Introduction 

The inherent two-way nature of communication links allows 
nodes to adapt their transmitted signals to the past received 
signals in exchanging their messages. Understanding the role 
of interaction lies at the heart of two-way communication. 
However, even for the point-to-point two-way communication 
first addressed by Shannon we are still lacking in our 
understanding of how to treat two-way information exchanges, 
and the underlying difficulty has impeded progress on this field 
over the past few decades. 

Since interaction is enabled through the use of feedback, 
, feedback is a more basic research topic that needs to be 
explored towards understanding two-way communication. The 
history of feedback traces back to Shannon |2| who showed 
that feedback provides no gain in capacity for discrete memo- 
ryless point-to-point channels. Although feedback can indeed 
increase the capacity of multiple access channels jS], Q, 
the increase in capacity for the Gaussian case is bounded 
by 1 bit for all channel parameters |5|. Due to these results, 
traditionally it is believed that interaction has had little impact 
on increasing capacity. 

In contrast, recent research shows that feedback provides 
more significant gain for communication over interference 
channels (ICs) |'6l, fT^. Interestingly the feedback gain is 
shown to be unbounded, i.e., the gap between the feedback 
and nonfeedback capacities can be arbitrarily large for certain 
channel parameters. This result motivates us to challenge 
system implementation, since it relies on an idealistic sce- 
nario where perfect feedback is given for free. So a natural 
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question that arises is to ask whether feedback can provide 
a net increase in capacity even if feedback cost is taken into 
consideration. The first attempt to address this question has 
been made in fSl where it was shown that one bit of feedback 
is worth at most one bit of capacity, when feedback links are 
modeled as rate-limited bit pipes. This implies that there is no 
net feedback gain unless feedback cost is cheaper. 

However, this result does not well evaluate the net feedback 
gain in a more realistic scenario where feedback is provided 
through the backward IC, not through bit pipes. This motivates 
us to explore two-way ICs where both forward and backward 
channels are ICs but not necessarily the sameQ We first 
consider a simple scenario where there are only two forward 
messages and feedback is offered through the backward IC 
for helping forward-message transmission. To capture pos- 
sibly different symbol rates between forward and backward 
channels^ we introduce a parameter A which indicates the 
fraction of time that the backward channel uses for feedback. 
The remaining (1 — A) fraction of time can be used for other 
purpose, e.g., sending two independent backward messages. 

For the Avestimehr-Diggavi-Tse (ADT) deterministic 
model f9l of this channel, we develop inner and outer bounds 
on the feedback capacity that match for a wide range of 
channel parameters. As a result, we find that the capacity gain 
due to feedback can be strictly larger than the capacity gain 
due to the use of the backward IC for sending independent 
backward messages. In other words, the backward IC can 
be more efficiently used for sending feedback signals that 
aid forward-message transmission, rather than if it were used 
for transmitting its own independent backward messages. 
This finding shows that feedback can provide a net gain in 
capacity even if we take feedback cost into consideration, i.e., 
subtract the capacity gain due to the independent-backward- 
message transmission. The gain comes from the fact that the 
backward ICs use for feedback enables the exploitation of side 
information at forward-message-senders to make the backward 
IC effectively more capable. We also extend this idea to a more 
general scenario where there are two additional independent 
backward messages. As a consequence, we show that interac- 
tion can provide an arbitrarily large gain in capacity. Moreover 
we find that this gain can be larger when allowing the mixture 
of forward-and-backward messages for transmission. 

Related Work: In 1 10], Sahai et.al. also considered the two- 
way IC with two forward messages, and they showed that there 
is no net feedback gain when forward-and-backward channels 

'In FDD systems, the forward and backward channels are on completely 
different bands. In TDD systems, those channels can be on different subcar- 
riers or different coherence times. 

-In 3GPP-LTE and WiMAX systems employing an OFDM modulator, only 
a few subcarriers are assigned for feedback, which incurs different forward 
and backward (feedback) symbol rates. 
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Fig. 2. Net feedback gain: (n, m) = (2, 1) and (n, m) = (1, 1). 



Fig. 1. Two-way ADT deterministic interference channel (IC). 



are the same and lie in the strong interference regime. On 
the other hand, we consider arbitrary forward and backward 
channels, and find that feedback can provide a net capacity 
gain for some channel regimes. In Section lVlIl we will provide 
details on this. 



II. Model 

Fig.[T|describes a two-way ADT deterministic IC where user 
k wants to send its own message to user k, and user k feeds 
back a function of its received signal over the backward IC 
during the A fraction of time. A: = 1, 2. We assume that W\ and 
W2 are independent and uniformly distributed. For simplicity, 
we consider a setting where both forward and backward ICs 
are symmetric but not necessarily the same. In the forward 
IC, n and m indicate the number of signal bit levels for direct 
and cross links respectively. The corresponding values in the 
backward IC are denoted by (ri, tti). Let G ]p™'''^("'™) 
be user fc's transmitted signal and Vfc 6 F™ be a part of 
visible to user fc). Similarly let Xfe be user fc's transmitted 
signal and Vfc be a part of Xfe visible to user fc). 

The encoded signal X^i of user k at time i is a func- 
tion of its own message and past feedback signals: X^i — 
A.(VKfe,yr')- We define YlT^ := {Ykt}\zX where Yut 
denotes the feedback signal received at user k at time t. User 
fc's transmitted signal Xki is a function of its past output 
sequences: Xki = fki{Yk^^)- We assume that the A fraction of 
time is assigned to the backward channel to use for feedback. 
This induces '^f^iH{Xki) < A^A max(n, m), where N 
indicates code length. We define X^ as a whole vector that in- 
cludes feedback signals as well as null signals (mapping to no 
feedback transmission), e.g., X^ = {0, Xk2, 0, XkA, • ■ • }. A 
rate pair {Ri,R2) is said to be achievable if there exists a 
family of codebooks and encoder/decoder functions such that 
the average decoding error probabilities go to zero as code 
length N tends to infinity. The capacity region C is the closure 
of the set of achievable rate pairs. The sum capacity is defined 
as Csum = sup {Ri + i?2 : (i?i, i?2) e C}. 



III. Main Results 
Theorem 1 (Achievability): Let a = —. 



min {Cno + 2An, Cpf } , 
^sum = { niin {Cno + 2Amax(ri 
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where Cno and Cpf indicate the nonfeedback and perfect- 
feedback sum capacities respectively ifTTIl . llT2ll . Q: 

r 2n, 

Cno — { ^ max(n — m, m), 
[ max(2n — m, m), 

Cpf = max(2n — m, m). 

Proof: See Section HV] 
Theorem 2 ( Outer Bound): 

min {Cno + 2 An, Cpf} , 
Csum < ( min {Cno + 2Amax(n, m), Cpf } 

Cnoi 



a > 2, 
2 

3' 
O.W. 



a < 



Proof: See Section |V] ■ 
Theorem 3 (Sum Capacity): The inner bound and the outer 
bound (given in Theorems [T] and [2] respectively) match and 
thus establish the sum capacity, except for the regime of 
(a < |, a < 1), where a := ^. 

Proof: The proof is immediate. Note that the inner and 
outer bounds differ only when a < |. The inner bound 
contains 2Amax(r;, — m,m), while the outer bound has 
2A max(n, m). These two terms coincide if a > 1; differ 
otherwise. ■ 
Net Feedback Gain: Note that in two-way communication, 
there are two ways of using the backward IC: (1) Sending 
independent backward messages; (2) Sending feedback sig- 
nals to help forward-message transmission. Using the above 
theorems, we will now explain why the backward IC can be 
more efficiently used for the second purpose, rather than if it 
were used for the first purpose. Consider an example where 
{n,m) = (2,1) and {h,rh) = (1,1)- Suppose that the A 
fraction of time is assigned for sending independent backward 
messages. The capacity gain offered by the backward IC is 



ACs. 



ACb = A bits, 



(1) 



where Cb denotes the nonfeedback sum capacity of the 
backward IC. In this example, Cb = 1. Suppose that the A 
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fraction of time is now assigned for feedback. Then, due to 
Theorems [T] and [31 the capacity gain offered by the backward 
IC is 

ACsum = niin {2A max(n — m, m), miii(m, 2n — 3to)} 

= min{2A, 1} bits. (2) 

Fig-Elplots these two capacity gains as a function of A. Notice 
that when A = 0.5, the capacity gain due to the first purpose 
is 0.5 bits; on the other hand, the capacity gain due to the 
second purpose is 1 bit. Without feedback cost, the capacity 
gain due to feedback is 1 bit. Taking the feedback cost into 
consideration, we now subtract the capacity gain due to the 
first purpose; hence, a net gain in capacity is 1 — 0.5 = 0.5 
bits. This implies net feedback gain. 

IV. Proof of Achievability 

Review of the Perfect Feedback Scheme Il7]|: Let us 

start by examining the perfect feedback scheme. In the very 
strong interference regime of a > 2, feedback creates a better 
alternative path, e.g., [Userl — s> User2 — s> feedback 
User2 Userl], thus enabling each user to relay the other 
user's information. In the regime of a < |, information is 
split into common and private parts. Feedback allows each 
user to decode other user's common information to forward it 
later. This forwarding enables user k to refine the corrupted 
information in the past while not interfering with the other 
user's transmission. Here the key observation is that perfect 
feedback enables each user to decode the other user's common 
information. Our model, however, provides feedback in the 
limited fashion, rendering the decoding operation challenging. 
We will next show how to overcome this challenge. Our 
feedback strategy is categorized into three types depending 
on the values of {a, a). 

A. Type I: a>2 

Let us explain the scheme with an example in Fig. [5] where 
{n,m) = (1,3), {h,m,) = (1,1) and A = i. Similar to the 
perfect feedback scheme, it has two stages. In the first stage, 
each user starts with sending Cno/2 — n bits on the upper 
levels. In this example, each user sends 1 bit. On the next 
lower level, it sends an additional bit; as a result, user 1 and 
2 send (01,02) and (61,62) respectively. User 1 then gets oi 
while receiving (61,62) from user 2. Similarly user 2 gets 61 
and (ai, 02). 

Similar to the perfect feedback scheme, user k feeds back 
the other user's information (not received yet at the desired 
place). But the difference here is that this transmission is 
through the backward IC. Suppose that user 1 and 2 simultane- 
ously send 62 and 02 respectively. Then, it seems impossible 
to decode these two bits, since each user receives the same 
signal. It seems that two time slots are needed to feed back 
these two bits. However, we can actually accomplish this in 
one shot. The idea is to exploit side information. Exploiting 02 
as side information, user 1 can decode 62, and similarly user 
2 can decode 02. Here the key observation is that with side 
information at user 1 and 2, the backward IC can be viewed 
as two non-interfering point-to-point channels. In the second 
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Fig. 3. Type I achievable scheme for a := ^ 

When side information is exploited at user 1 and 2, the backward IC 
can be cast as two non-interfering point-to-point channels. This enables hvo- 
bit transmission of (b2, a2) over one-bit-capacity backward IC, thus providing 
net feedback gain. 



Stage, each user sends its own fresh information on the first 
level and forwards the other user's information on the second 
level: user 1 and 2 send (03, 62) and (63, 02) respectively. User 
1 can then decode its own fresh information 03 as well as 02 
which was not received in the first stage. Similarly user 2 can 
decode (63, 62). Therefore, we can achieve the sum rate of 3, 
showing a 50% improvement from the nonfeedback capacity 
of 2. Note that the backward channel is utilized once every 
two slots and therefore we satisfy the constraint of A = i. 

We now extend this to arbitrary values of (n, m), {n, rri) and 
A. In the first stage, each user starts with sending Cno/2 = n 
bits on the upper levels. On the next lower levels, it sends the 
following number of additional bits: 



min{2An, Cfb — Cno}, 



(3) 



where Cfb — Cno = m — 2?! in the regime a > 2. Notice 
that the maximum number of bits that can be squeezed in is 
limited by Cfb — Cno- Recall from the above example that the 
backward IC can be cast into two non-interfering point-to- 
point channels. So the effective capacity of the backward IC 
per user for the purpose of feedback is n. We multiply this 
by 2, as two stages are employed^ Through the backward IC, 
user k can now relay the amount min{2A?T,, Cfb — Cno} of 
the other user's information. In the second stage, each user 
sends Cno/2 fresh bits on the upper levels and the other user 
information (decoded with feedback) on the next lower levels. 
User k can then decode Cno + min{2An, Cfb — Cno} during 
the two stages. Therefore, we can achieve i?5um in Theorem[T] 
Remark 1 (Exploiting Side Information): Note in Fig. [5] 
that the two bits (62,02) can be fed back through the one- 
bit-capacity backward IC. This is because each user can 
cancel the seemingly interfering information by exploiting its 

^Here 2\h can be a non-integer rational number, which is incompatible 
with an input of the ADT model. However, we can resolve this by employing 
multiple time slots, say M, within each stage, since 2XhM can be made an 
integer 



4 



want 


hi 


Stage 2 


stage 1 


bi 




as 


02 


ai 


?>! 






want 




side info 




ai a 








side info 


6i 




Stage I 




Stage 2 


ai 




hi 




hi 


03 ffi ai 


bi 




ai 


h2 ® 


ai 


63® ^1 










Fig. 4. Type II achievable scheme for a :- 
A=i. 



1 and 



own information as side information. This enables the net 
feedback gain: a capacity increase of 1 bit with ACb = \ 
bits of the backward IC's original capability. The nature of 
the feedback gain offered by side information coincides with 
that of the butterfly example [13] and many other network- 
coding examples lEl, Us], d, Q, 113, □ 



B. Type II: a < |,(5 > i 

We explain the second-type scheme using an example 
illustrated in Fig.|4] Here {n, m) = (2, 1), (n, rh) = (1, 1) and 
A = i. Similar to Type I, it has two stages. In the first stage, 
each user starts with sending Cno/2 — max(n — m,m) bits, 
comprised of {n ~ m) private bits and {2m — n)+ common 
bits. In this example, each user sends one private bit only. 
On the upper common levels, each user sends the following 
number of additional bits: 



min{2Am, Cpf - Cno}, 



(4) 



where Cpf — C^o — min(m, 2n — 3m) in the regime a < |. 
In the sequel, we will show that in this regime the backward 
IC can be viewed as two non-interfering cross point-to-point 
channels, thus making the effective capacity of the backward 
IC per user rfi. So we have used the 2Am for the number of 
additional bits. Similarly, a factor of 2 is multiplied due to the 
two-stage nature of the scheme. In this example, 2Am — 1. 
So user 1 and 2 send ai and 61 respectively. 

In the perfect feedback scheme, user 1 wanted to know 
the other user information hi which caused interference to its 
desired symbol 02. Similarly user 2 wanted to know ai. And 
to satisfy this demand, the two bits (02 © 61, &2 ® ai) were fed 
back to the users. Suppose we mimic this transmission: user 
1 and 2 send 02 ffi hi and &2 © oi respectively. Unfortunately 
this does not work. User 1 cannot decode hi from the received 
signal ai ©a2 ©61 ® 62 and similarly user 2 cannot decode ai. 
It seems that two time slots are needed to feed back these two 
bits. However, we can satisfy the demand in one shot. Note that 
the symbol hi wanted by user 1 is available at user 2. Similarly 
the symbol oi wanted by user 2 is available at user 1. Suppose 



we now send these two bits instead. User 1 and 2 can then 
decode hi and ai respectively, exploiting its own signal as 
side information. The key observation here is that exploiting 
side information at user 1 and 2, the backward IC becomes 
equivalent to two non-interfering cross point-to-point channels. 
This enables feeding back the following number of bits: 
min{2Am, Cpf — Cpo}. In the second stage, each user starts 
with the nonfeedback scheme and additionally sends the other 
user's information (decoded with feedback) on vacant common 
levels. User k can then decode Cno + min{2Am, Cfb — Cno} 
bits during the two stages, thus achieving i?5um in Theorem [T] 



^,5 < 



C. Type III: a < 3 , 

The only distinction with respect to Type II is that in this 
regime of a < i, the effective capacity of the backward IC 
per user for the purpose of feedback is now n — fh. This 
is because the backward IC is now equivalent to two point- 
to-point channels composed of private levels only. In Fig. H] 
remember that user 1 fed back ai to user 2 through the cross 
link, so the transmission rate was limited by ifi. However, 
in the regime of a < i, n — m > m. This motivates us 
to consider a better alternative: user k uses h — fh private 
levels for feedback. For example, user 1 can alternatively feed 
back a2 © 61 using a private level, thus allowing user 1 to 
decode hi as 02 can be subtracted. Also this private-level 
transmission does not hurt the other-link transmission. Taking 
this alternative, the effective capacity of the backward IC per 
user for the purpose of feedback is n — fh. This way, user 
k can decode Cno + min {2A(n — m), Cfb — Cno} bits during 
the two stages. This completes the proof. 

V. Proof of Outer Bound 
One can see that it suffices to prove the following bounds: 

Csum < min {2n + 2An, (5) 
(n — m)^ + max(n, to), (6) 
2 max(n — TO, to) + 2A max(n, to)} . (7) 

The proof of the bound (|5]l is based on the standard cutset ar- 
gument. Note that the bound ^ matches the perfect-feedback 
bound 1 7 1, 1 10|; hence it is also an outer bound of our channel. 
For completeness, we include these proofs in the following 
subsections. The main focus of this section is to prove the last 
bound 

A. Proof of ^ 

Starting with Fano's inequality, we get 

N{Ri - eat) < /(W^i; Yi^, , W2) 

^=^5]i7(rH|Ty2,rr\i^'-\X2.) 

+ H{Y2^ I W2 , ,Y^-\X2,,Xu) 

< ^ i7(rH|X2,) + 51 ^(^^2,1^1.) 

id) 

< N{n + An) 
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where (a) follows from the fact that Wi is independent of W2, 
and X2i is a function of (W2,^2~^)' (^) follows from the 
fact that Xii is a function of 1^"^; (c) follows from the fact 
that conditioning reduces entropy; (d) follows from the fact 
that the right-hand-side is maximized when {Xi,X2, Xi,X2) 
are uniform and independent, and J2 ^i^2i\Xii) < NXh. 
Similarly we can show A^(i?2 -eat) < N{n + Xn). If (i?i,i?2) 
is achievable, then eat — s> as tends to infinity. Therefore, 
we get the desired bound. 

B. Proof of ^ 

Starting with Fano's inequality, we get 

N{Ri +R2- eat) < I{Wi;Yf\W2) + I{W2;Yf) 
= H{Y,''\W2)+H{Yf) 

- {H{Y,^,Yi'\W2) - H{Y,^\W2,Yi')} 
= H{Yl'\W2,Yf) - H{Yf\W2,Yl') + H{Yf) 
<H{Yl'\W2,Yf) + H{Yf) 

J2 H{Yu\W2,Yf, Yr\Xl,X2^, n,X2^, Vu) + 

< N {{n ~ m)^ + max(n, m)} 

where (a) follows from the independence of (Wi,W2); (b) 
follows from the fact that XI is a function of Y^^^, X2i is a 
function of {W2,Y2~^), and Vu is a function of {X2i,Y2i)', 
(c) follows from the fact that conditioning reduces entropy. 
This completes the proof. 

C. Proof of 

Starting with Fano's inequality, we get 

NiRi +R2- eat) < /(VFi; Fi^) + I{W2;Yf) 
= H{Y^) - H{Y^\Wi) + H{Yf) - HiYf\W2) 

+ - H{Yf\W2) - H{V2''\Yf)} 

^^H{Yr\Vf)+H{Yr\V2'') 

+ {/(Fi^; W2) + i?(T/2^|W^i) - i?(Fi^|W^i) - ff(Fi^lri^)} 
+ {/(t/2'^; W-i) + iI(t/i^|W^2) - HiYf\W2) - HiV2''\Yf)} 

< H{Y^^\Vi'') + H{Yf\V2^) + HiY^'^lWi) + H{Yf\W2) 

< J2 [HiyulVii) + H{Y2^\Vu) + H{Yu) + H{Y2^)] 

< 2N max(n — m, m) + 2iVA max(n, to) 

where (a) and (fe) follow from a chain rule; (c) follows 
from Claim [T] (see below); (d) follows from the fact that 
conditioning reduces entropy; (e) follows from 'Y^H{Yki) < 
N\max{h,fh). Therefore, we get the desired bound. 
Claim 1: For (fc, I) = (1, 2) or (fc, I) = (2, 1), 

I{V^-Wi)+H{V,''\W^)~H{Y^\Wk)~H{V^\Y,^) 

<H{Yi'\W^.). 



Proof: By symmetry, it is enough to prove only one case. 

liVl"; W2) + H{V2''\W,_) - HiYflWi) - H{V^\yI') 
/(V^i^; W2) + {i/(T/2^|W^i, Fi^) - fi^)} 
+ 7(^2'^; Yf\Wi) - /(Fi^; Yf\Wi) - H{Vf\Y,'') 

I{V,^;W2) + H{Y,^\WuY,^) 
- H{Y^^\Wi,V2^) - H{V^^\Yf) 

< I{Vf; W2) + iJ(fi^|M^i, ^1^) 
+ H{V^''\Wi,Yl') - H{Vf\Y^'') 

(d) 

< I{V,'';W2)+H{Y,^\W,,V,'') 

< /(VKi, Fi^; W2) + H{Y^''\Wi,V^'') 

= il(fi^lVFi) 

where (a) follows from a chain rule; (6) follows from 
i7(Y]^|VFi, fi^) = H{Vf\Wi,Yf) due to the fact that X^ 
is a function of (Wi,Y]^^^); (c) follows from a chain rule 
and the fact that entropy is non-negative; (d) follows from the 
fact that conditioning reduces entropy; (e) follows from the 
fact that Vf is a function of {Wi,Y^^~^). ■ 

VI. Two-way IC with Four Messages 

Motivated by the fact that feedback can provide a net 
capacity gain, we now explore the role of interaction in a more 
general scenario where there are four messages in total: two 
forward messages; and two additional independent backward 
messages from user k to user fc, fc = 1, 2. In this scenario, the 
encoded signal X^i of user k is now a function of {Wk,Yj^~^) 
instead of Y^~^ only. 

We will demonstrate from an example in Fig. |5] that in- 
teraction can improve the non-interactive rate significantly. 
For simplicity, we focus on a sum-rate pair of the forward 
and backward messages, denoted by (i?sum, ^^sum) := {Ri + 
R2, Ri + R2)- Note that the non-interactive capacity region is 
{(i?sum,^'sum) : i?sum < 2, ^sum = 0} fu], 112. On the Other 
hand, we will show that interaction gives: 

{(-^sutrn -^sum) • -^sum — 1; -^sum ^ -^sum — 3}. (8) 

Note that interaction provides an arbitrarily large gain in 
capacity. i?5um can be increased up to 1 from 0, which implies 
an 00% improvement. With Type-I and Type-II schemes 
in Section HVl we can achieve the (0,1) and (3,0) points 
respectively. On the other hand, a new idea emerges to achieve 
a corner point of (2, 1). 

The example in Fig. |5] shows an achievable scheme for the 
(2, 1) point. Here we will demonstrate that during two stages, 
user 1 and 2 can send (01,02) and (61,62) respectively, while 
user 1 and 2 can transmit a and b respectively. In the first 
stage, user 1 and 2 send ai and 61 using its own private 
level respectively. Meanwhile user 1 and 2 send a and b 
respectively through the backward IC. User 1 then gets the 
unwanted information b and similarly user 2 receives d. In 
the second stage, through the forward IC, user 1 feeds b back 
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Fig. 5. Two-way interference channel with four messages. Illustration of an 
achievable scheme for (iJsum,flsum) = (2, 1). 

to user 1 using the top level, and similarly user 2 feeds a 
back to user 2. Here the key observation is that this feedback 
transmission comes for free, i.e., it does not hurt forward- 
message transmission of (02,62). Notice that a and h are user 
I's and 2's own information respectively. This allows user 

1 and 2 to send their own forward information 02 and 62 
without being interfered. In other words, exploiting a as side 
information, user 1 can decode a2, and similarly user 2 can 
decode 62. Upon receiving (6,5), user 1 and 2 transmit the 
other user's information respectively, thus enabling user 1 and 

2 to decode their desired signals. Therefore, we can achieve 
(2,1). 

Mixing Forward-and-Backward Messages: Interestingly, 
this interactive scheme includes the mixture of forward-and- 
backward messages. Note that in the second stage, user 1 
sends (6,02) at the same time. We say that interaction is 
strong if the mixture is allowed. On the other hand, if the 
mixture is not allowed (that we call weak interaction), the 
performance is degraded. For example, we can show that given 
the constraint of i?sjm = 1, the weak interaction provides at 
most 1.5 bits for i?5jm. See Appendix lAl for the proof. This 
shows that interaction can provide larger gain when allowing 
for the mixture of different messages. 

VII. Discussion 

A. Net Feedback Gain 

Using Theorems [T] and |2] we identify channel regimes where 
feedback can provide a net gain in capacity. See Fig. |6] 
In fact, Sahai et.al. flOl also considered the two-way ADT 
deterministic IC with two forward messages, and showed that 
for a = a > |, there is no net feedback gain. In this work, 
we consider arbitrary forward-and-backward ICs. As a result, 
for the regimes of | < a < 2 and (a > 2,(5 > 2), we 
obtain the similar result: there is no net feedback gain. For 
(a < |, 5 > |) or (a > 2, (5 < 2), however, we show that 
feedback can provide a net gain in capacity. Here we say that 
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Fig. 6. Two-way IC with two forward messages: Net gain. 




Fig. 7. Two-way parallel IC with four messages. The rich diversity on 
channel gains across many parallel subchannels can often occur in broadband 
systems. 

net feedback gain occurs if there exists A such that the capacity 
gain due to feedback is strictly larger than the capacity gain 
due to independent-message transmission. For the remaining 
regime (a < |,q; < |), whether or not feedback provides 
net gain remains open. The optimaUty proof of our achievable 
scheme with a new converse proof will show no net gain in this 
regime. Or enhancing Type-II or Type-Ill schemes (if possible) 
will show net feedback gain in this regime. 

B. Potential to Broadband Systems 

In Fig. |6] we have seen that there is net feedback gain when 
the forward IC well matches with the backward IC. We can 
also check that the gain is significant when there is strong 
asymmetry between a and a. While this strong asymmetry is 
not likely to occur in narrowband systems, it can often occur in 
broadband systems where there are a multitude of subchannels 
with a wide dynamic range of channel gains. For example, in 
3GPP-LTE and WiMAX systems, we can easily expect rich 
diversity on channel gains, since an operating bandwidth of 
the systems (around 20 MHz) is much larger than coherence 
bandwidth of typical wireless channels (around the order of 
0.1 MHz). 

Fig. |7] illustrates an example which can represent this 
scenario where there are a variety of parallel subchannels. 
Using our results, we can see that pairs of (FWi,BACK2) 
and (FW2, BACKi), for instance, can provide significant gain 
with interaction. One more interesting observation is that even 
though forward-and-backward parallel subchannels are identi- 
cal, there exist many pairs of forward-backward subchannels 
that can provide a net capacity gain. In tomorrow's commu- 
nication systems, we expect a broader system bandwidth to 
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support a variety of multimedia services. Therefore, we believe 
that our feedback idea will provide more significant insights 
into the design of future communication systems. 

VIII. Conclusion 

For the two-way ADT deterministic IC, we developed 
three types of achievable schemes and derived outer bounds, 
thereby establishing the sum capacity except for the regime 
of (a < |, a < 1). As a consequence, we developed a new 
viewpoint on the use of the backward IC: the backward IC 
can be more efficiently used for feedback rather than if it were 
used for sending its own backward messages. The gain comes 
from the fact that the channel use for feedback enables the 
exploitation of side information at forward-message-senders 
to make the backward IC effectively more capable. Our future 
work is along several new directions: (1) Extending to general 
channel settings; (2) Exploring the four-message two-way IC 
further; (2) Translating to the Gaussian channel. 

Appendix A 
Proof of Csum = 1.5 when Rsum = 1 

For achievability, we split the forward channel into two 
parts: assigning the i fraction of time for sending feedback 
signals for aiding backward-message transmission; assigning 
the remaining | fraction of time for sending its own forward 
messages. Then, using Type-I scheme, we can easily achieve 
(1.5,1). For converse, we split each channel into two parts 
and then use Theorem |2] Similar to A, we define A as the 
fraction of time that the forward channel uses for feedback. 
Using Theorem m we then get: 

i?5um < min |2(1 - A) + 2A, 3(1 - A)| , 

^sum < min |4A, 1 — a| . 

Since i?sum = 1, A = and A = i. Therefore, i?sijm < 1-5. 
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